Extensive and Sub-Extensive Chaos in Globally-Coupled Dynamical Systems 
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Using a combination of analytical and numerical techniques, we show that chaos in globally- 
coupled identical dynamical systems, be they dissipative or Hamiltonian, is both extensive and 
sub-extensive: their spectrum of Lyapunov exponents is asymptotically flat (thus extensive) at the 
value Ao given by a single unit forced by the mean-field, but sandwiched between sub-extensive bands 
containing typically ©(log TV) exponents whose values vary as A ~ X^o + c/ log TV with X^o 7^ Aq. 

PACS numbers: 05.45.-a, 05.45.Xt, 05.70.Ln, 05.90.-fm 



Dynamical systems made of many coupled units with 
long-range or global coupling are models of numerous im- 
portant situations in physics and beyond, ranging from 
the synchronization of oscillators and neural networks to 
gravitational systems, plasma, and hydrodynamics [HQ- 
Their properties can be quite remarkable: for instance, 
globally-coupled dissipative systems can give rise to col- 
lective chaos, where macroscopic variables show incessant 
irregular behavior due to nontrivial correlations between 
local units 0]. Their Hamiltonian counterparts, in the 
microcanonical ensemble, are now well-known to show 
negative specific heat, long-lived quasi-stationary states, 
all features ultimately related to their non-additivity [H. 
Their unusual properties make these systems deceptively 
close to simple mean-field approximations and show that 
they are, in many ways, less well understood than sys- 
tems with short-range interactions. 

The status of the chaos which may be present in these 
dynamical systems is particularly unclear: whereas sys- 
tems with short-range interactions are now well-known 
to exhibit extensive chaos at least in the absence of 
non-trivial collective behavior there is, in our view, no 
solid evidence or argument for or against the extensivity 
of chaos in long-range or globally-coupled systems. 

In most dynamical systems, chaos is customarily quan- 
tified by Lyapunov exponents (LEs), which measure the 
average rate of divergence of nearby trajectories, and 
more specifically by Lyapunov spectra, where the LEs 
A^*-* are arranged in descending order. When Lyapunov 
spectra, plotted as functions of (i — collapse rea- 

sonably well onto each other for different system sizes 
iV, chaos is deemed extensive. This has been observed 
repeatedly in locally-coupled systems, but never with 
global or long-range coupling, even for the largest sizes 
reachable numerically today (see, e.g.. Fig. [SJa) below). 
Yet, a nai've argument suggests extensivity in this lat- 
ter case: for identical units submitted to the same self- 
consistent mean-field forcing, the LEs should all take the 
same value (hereafter Aq), a trivial realization of exten- 
sivity. But this is strictly true only if the N ^ 00 limit is 
taken first, which may be misleading when dealing with 



LEs, as they are essentially infinite-time averages. In 
fact, the Lyapunov spectra of finite-size globally-coupled 
systems always remain far from being flat. 

For the paradigmatic and much-studied Hamiltonian 
mean- field (HMF) model [1, Q, the situation is simi- 
larly confusing: the naive argument above gives all LEs 
at zero, whereas a calculation by Firpo yielded a posi- 
tive largest exponent at any finite TV, with a well-defined 
N 00 limit [8| . A theoretical formulation as a quantum 
many-body problem mentioned the possibility of a van- 
ishing fraction of non-zero exponents [9[, but numerical 
results have produced contradictory results 

In this Letter, we show that chaos is not fully extensive 
in systems of globally-coupled identical units. Rather, 
their Lyapunov spectra, in the large-size limit, converge 
to flat extensive regions where the LEs do take the value 
Ao given by the single unit forced by the mean field, 
but these regions are bordered by sub-extensive layers 
containing exponents taking different values. In par- 
ticular, we provide a theoretical analysis and numerical 
evidence showing that the largest LE A'^' converges as 
A^^' ~ Aoo + c/ log TV to an asymptotic value Aoo > Aq. 
Our numerical analysis reveals that the sub-extensive 
boundary layers contain ©(log TV) Lyapunov modes and 
that their LEs take the same asymptotic value Aoo- We 
finally argue that our results probably hold also in the 
presence of collective chaos. 

We first study TV globally-coupled dissipative maps 
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with j = 1,...,TV, time t, coupling constant e, and a 
chaotic local map f{x), which is chosen here to be one- 
dimensional for the sake of simplicity. If f{x) shows suffi- 
ciently strong mixing, its Jacobian may be approximated 
by a random multiplier. The tangent-space dynamics of 
Eq. (d)) is then simplified as 
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with iid random numbers , unless the couphng e is 
too strong to regard fiVj) as independent. The mean- 
field forcing argument amounts to ignoring the global- 
coupling term in Eq. Q , which is then reduced to the bi- 
ased Brownian motion of a particle of coordinate log 
with average velocity Aq = (log |(1 — e)fi*\) and difi'usion 
coefficient D = ((log|(l — e)/^j| ^o)^), where Aq is the 
mean-field LE. From this viewpoint, the full system ([2]) 
can be seen as N interacting Brownian particles. Assume 
now that the Lyapunov vector [vl, . . . , w^] is sufficiently 
localized, which is indeed the case except when it is asso- 
ciated with collective behavior In this case, its largest 
component v\.j dominates the coupling term in Eq. ([2|). 
Thus, the Brownian particles log |w* | diffuse freely as long 
as 1(1 — e)f*| » \{e/N)v\f\, otherwise the coupling term 
takes effect, keeping any |(1— £)w*| larger than \{e/N)v\j\. 
In other words, the N Brownian particles log \Vj \ diffuse 
within a box of size log[A^(l — e)/e], whose right end cor- 
responds to the rightmost particle, while the other end 
pulls all the particles left behind. The first LE A*-^-* is 
then simply given as the average velocity of this box. 
This process is described by the following Fokker-Planck 
equation in a frame moving at velocity A^^-*: 

where u is the coordinate in this frame and the particle 
distribution function P{u, t) is confined, roughly, in < 
u < Umax = log[iV(l — e)/e]. For large N, its stationary 
solution can be approximated by the one in the limit 
Mmax oo, P,(m) = (2AA(iV-D) exp(-2AA(i)u/i:i) with 
AA(^) = A(i) - Aq. Further, by the definition of the box, 
there should be 0(1) particles near its right end Umax, 
which implies Ps{u)du = ci/N with a constant ci ~ 
0(1). This yields our central result for the first LE: 



AA(i) =AW-Ao 
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with C2 = log[£/((l — s)ci)]. The probability distri- 
bution 'P('y) for the vector components Vj is V^v) — 
Ps{\ogv){du/dv) ^ y-2-c2/ logN ^ whose exponent is 
smaller than —1 and thus consistent with our assump- 
tion of localization of the Lyapunov vector. A similar 
resuh holds for the last LE |lll: AA^^) = A^^) - Aq ~ 
— (£'/2)(l + Cj/logA^) with another coefficient Cj. 

These results are confirmed in Fig. [T] by direct simu- 
lations of the random multiplier (RM) model © and of 
globally-coupled maps (GCM) © [if. 

For the RM model, we used e = 0.1 and /i*- = 
± exp^*/(l — e) with random signs (here with proba- 
bility 0.6) and ^* drawn from the centered Gaussian with 
variance a^, which gives Aq = and D = a^. Quantita- 
tive agreement is found with Eq. ^ for the first LE and 
its counterpart for the last LE [Fig. [Il[a,c)]. 

For our GCM system, we chose skewed tent maps 
f{x) = bx (resp. b{x - 1)/(1 - b)) if < x < 1/6 (resp. 
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FIG. 1: (color online). Size-dependence of the first and last 
LEs [12. (a,b): AA^i' and |AA(^'| against 1/logiV for the 
RM model with a = 1 (a) and for the skewed-tent GCM 
with & = 4 (b). Dashed lines indicate linear fits to the data. 

(c) Estimated value of AAli' = limjv^oo AA'^' for the RM 
model and our GCM with varying a and b, respectively, plot- 
ted against D/2. The diffusion constant D is obtained by 
D = for the RM model and numerically measured for the 
GCM. Dashed line: AAI^' = D/2 as predicted in Eq. (gj. 



l/b < x < I) coupled with strength e = 0.02. The 
results in Fig. [TJb) demonstrate again the logarithmic 
size-dependence of AA^^^ and AA*^^). Their asymptotic 
values are not symmetric anymore [Fig.[ljb)], but the de- 
viation from D/2 remains small [Fig. [IJc)]. In addition, 
we note that here Aq depends residually on N through 
changes in the invariant measure. This effect is however 
so weak that in practice we observe the same logarithmic 
law for the first and last LEs, A^^' and A^^' . 

Let us summarize our results so far: The first and last 
LEs remain distinct from the mean-field forcing LE Aq in 
the N ^ oo limit. They are shifted from Ao by an amount 
AA controlled by D, the amplitude of the fluctuations in 
the Jacobian, and the coupling strength e is only involved 
in the logarithmic finite-size corrections [l3| . 

We now investigate the full Lyapunov spectrum of 
our systems. As seen above, it cannot be entirely fiat 
at Aq asymptotically. However, for finite-size systems, 
Lyapunov spectra become fiatter for larger sizes un- 
der the conventional rescaling A*^*-' vs h = (i — 
[Fig. Ufa)]. In the RM model, a closer look at the "bulk" 
LEs with fixed h reveals an asymptotic power-law decay 
A\{h) = A*^*' — Aq ^ 1/VN toward the mean-field forc- 
ing value Ao = [Fig. [^l^b)]. This scaling is only reached 
for large-enough sizes and sooner near the middle of the 
spectrum, as shown clearly by rescaled spectra AA \/N 
[Fig. dfc)]: they collapse very well within a central re- 
gion [hc{N),l — he{N)], with hc{N) decreasing toward 
zero as 1/A^ [Fig. [2][c) arrows and Fig. [2ljd)]. Thus, in 
the infinite-size limit, the Lyapunov spectrum of the RM 
model is indeed fiat at Aq, but sandwiched between two 



sub-extensive bands of LE taking different values [14 [ . 

That ft-c ~ 1/iV [Fig. (lid)] implies that the number of 
non-extensive LEs increases slower than any power of N. 
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FIG. 2: (color online). Full Lyapunov spectrum [T^]. (a) 
Spectra for difTerent sizes (arrows: increasing A'^) for the 
RM model with a = 1 (main panel, N = 128, 256, 512, . . . ) 
and for the skewed-tent GCM with & = 4 (inset. A'' = 
32, 128, 512, . . . ). (b) I AA| vs AT at fixed values of h. Dashed 
lines: |AA| ~ l/\fN. (c) Same data as in main panel of (a) 
in rescaled coordinate from A*' = 128 (main panel, innermost 
curve) to A^ = 16384 (inset, outermost curve). Arrows indi- 
cate the positions ha{N) at which spectra of size A^ and 2 A' 
start to collapse, (d) he{N) vaN. Dashed line: he{N) ~ 1/N. 



We now show that it actually grows logarithmically with 
A^. With fixed indices i, these LEs at size A^ seem to 
obey Eq. O, A^^ ~ aS + c^')/ log TV [Fig. [Sja)], but the 
estimated A^i' increase with i (dashed lines) , at odds with 
the monotonicity of the Lyapunov spectrum. This is bet- 
ter seen when plotting (Aj*^ log 2N — x'"^ log A^) / log 2 as 
estimates for A^ [inset of Fig. [HJa)], where aS is found 
to be larger than xi^} within the non-extensive region 
1 < * ^ *e = hcN. Instead, if we rescale the index loga- 
rithmically as /i' = (i — 1)/ (iQ -I- log A^), with io adjusted 
here for the LEs to show the 1 / log A^ law, the asymp- 
totic LEs Xoo{h') do not increase with h' anymore, but 
stay constant in the non-extensive region except near the 
threshold (Fig. ^h), left of the dashed line). This indi- 
cates that all the non-extensive LEs converge to the same 
value as the first LE and that their number increases log- 
arithmically with A^. The same conclusion is reached for 
our GCM system [Fig.|nUc,d)], though we could not com- 
pute all the non-extensive LEs within reasonable time 
|12| . In short, we find that 0{N) extensive LEs are sand- 
wiched by two sub-extensive bands at both ends of the 
spectrum, each of which consists of ©(logA^) LEs with 
asymptotic values shifted approximately by -D/2 from Aq . 

We now show that our results also extend to the 
HMF model, and thus probably also to other globally- 
coupled Hamiltonian models. Defined by the Hamilto- 
nian i? = ^ + W Ej,,' [1 " cos(0j - 9,,)], the HMF 

model is intensely studied mostly because its infinite-size 
limit displays an abundance of non-trivial solutions which 
appear as so-called quasi-stationary states at finite N 
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FIG. 3: (color online). Left sub-extensive band of the Lya- 
punov spectrum for the RM model with a = 1 (a,b) and 
for the skewed-tent GCM with 6 = 4 (c,d) [13]. (a) A^'' vs 
l/logA" for i — 1,4,16. Dashed lines indicate linear fits to 

the data. Inset: = ( A^^r log 2A' - A^^' log A') / log 2 vs i for 
A' = 256, 512, ...,8192 (see text). The horizontal and ver- 
tical dashed lines indicate A^' and a threshold index value 
estimated from he, respectively, (b) Same plot as the inset of 
(a) but with rescaled indices h' = (i — l)/(io + log A') with 
io — 15. (c,d) Same plots as the inset of (a) and (b) for the 
GCM with N = 512, 1024, . . . , 16384, and io = 5. 

d, 0|. Contradictory results exist about the nature of 
chaos in this model 0, [l^ , even in its reference "equi- 
librium" state. The motion of a single particle is given 
by 0^ = -Msin(6'j - 9), where Me'® = J2j is the 
mean field which is non-zero in the (equilibrium) ferro- 
magnetic phase present for energy density C/ < |. Here 
the naive argument yields Aq = because a single particle 
forced by a constant mean-field cannot be chaotic. 

We were able to extend the argument leading to E g. (HI ) 
to the HMF model (details will appear elsewhere 
At finite A^, the mean field fluctuates and the energy of 
a particle diffuses, so that it eventually visits the sur- 
roundings of U]\i = 1 + M, the unstable maximum of the 
mean-field potential. There, it experiences a chaotic kick, 
and this produces a finite diffusion coefficient D for the 
logarithm of the tangent-space amplitudes. Taking these 
effects into account, we obtain a strictly positive asymp- 
totic first LE with, again, l/logA^ corrections, which we 
numerically confirm in Fig.|4ja). The full Lyapunov spec- 
trum, on the other hand, gets fiatter for larger A" and 
we could observe the emergence of the AX{h) ^ 1/VN 
scaling [Fig. |4l[b)], but we are currently unable to study 
the larger systems, in order to overcome finite-size effects 
to obtain clear evidence of ©(logA^) sub-extensive LEs. 
Nevertheless, it is already clear from Fig. IH^b) that the 
/i-domain where the scaling holds widens with A^, 

suggesting a flat (zero- valued) extensive part with a sub- 
extensive, possibly logarithmic, band of positive LEs. 

We finally examine the infiuence of collective chaos 
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FIG. 4: (color online) (a-c): HMF model with energy density 
[/ = 0.7 [l2|. (a) First LE, maximum size iV = lO''. Dashed 
line: linear fit in the l/\ogN regime, (b) AA [= A) vs A'^ at 
fixed rescaled indices h. Dashed lines: AA ~ 1/\/N . (c) Posi- 
tions of the oscillator most contributing to the 1st and 256th 
Lyapunov vector (black dots and brown crosses, respectively) 
at A'^ = 512. Red dashed line indicates the separatrix. (d) 
First 3 LEs for globally-coupled Hopf oscillators (see text). 



on our results, an important generic case for dissipative 
globally-coupled systems Q . Lyapunov spectra then con- 
tain modes governing the macroscopic dynamics, whose 
associated covariant Lyapunov vectors are delocalized 
0. In the case of globally-coupled limit-cycle oscillators, 
W, = W, + \c^)\W,\^W, + K{\ + ici)((VF) - 
with complex variables W^, (W^) = Yl,j = —2.0, 

C2 = 3.0, and K = 0.47, the largest LE is such a collective 
mode 0. Here we see that it does not obey Eq. (g]) for 
N large enough while the following, "non-collective" LEs 
do [Fig.lljd)]. This result comforts the general picture of 
the macroscopic modes being present but asymptotically 
decoupled from the other ones in Lyapunov spectra, be 
they in the bulk or in the subextensive layers. 

Our findings recall the importance of the order of lim- 
its in systems with long-range interactions: For the ferro- 
magnetic phase of the HMF model for instance, consid- 
ering directly the infinite-size system (the Vlasov equa- 
tion [jj), one misses the fact that residual but influential 
chaos remains in the TV — )■ oo limit, even though the bulk 
exponents vanish asymptotically. The Lyapunov modes 
in the subextensive layers capture "extreme events" in 
phase space, much like the largest LE in locally-coupled 



systems 
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16| . For the HMF case, this is particularly 
clear since, whereas the covariant vectors for bulk LEs are 
carried by typical oscillators, the first Lyapunov vector 
is localized on those oscillators currently in the vicinity 
of the separatrix, the most unstable part of (local) phase 
space [Fig. IH^c)]. Even though they are in logarithmic 
numbers and localized on special regions of phase space, 
the Lyapunov modes of the subextensive layers may have 
an important impact on macroscopic properties, such as 



the thermodynamic entropy of Hamiltonian systems jl7{ . 

In summary, we have shown that microscopic chaos 
in systems made of N globally-coupled dynamical units 
exhibits a rather peculiar form of extensivity: their Lya- 
punov spectrum X{h) is asymptotically flat, thus "triv- 
ially" extensive, but sandwiched between sub-extensive 
bands with LEs taking different values. In presence of 
macroscopic dynamics, the corresponding collective Lya- 
punov modes are just superimposed on this structure. 
The bulk LEs converge as X{h) ~ Ao + cst./^/N to the 
value Ao given by a single dynamical unit forced by the 
mean-field. In contrast, the sub-extensive layers contain 
©(log N) LEs whose values vary as A ~ Aoo + est./ log 
with Aoo 7^ Aq. Investigating further the genericity of 
our results and providing a theoretical basis to the 1 / VN 
scaling of bulk LEs and the log N size of sub-extensive 
bands are important tasks left for future study. 
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